Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.

BACKGROUND: The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility. METHODS: A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment. RESULTS: After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support. CONCLUSIONS: We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.

Practice-Oriented Research: An Introduction to New Developments and Future Directions.

Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as well as factors associated with the participants of psychotherapy and its context, POR is ripe for new developments - regarding what to investigate and how to investigate it. This paper is the introduction of a series devoted to recent advances and future directions of POR as their pertained to routine outcome monitoring, technologies and artificial intelligence, the integration of constructs and methods from program evaluation and implementation science, and the investigation of populations with limited financial resources across various regions of the world. The series also includes commentaries from two leaders of POR.

How can a behavioral economics lens contribute to implementation science?

BACKGROUND: Implementation science in health is an interdisciplinary field with an emphasis on supporting behavior change required when clinicians and other actors implement evidence-based practices within organizational constraints. Behavioral economics has emerged in parallel and works towards developing realistic models of how humans behave and categorizes a wide range of features of choices that can influence behavior. We argue that implementation science can be enhanced by the incorporation of approaches from behavioral economics. Main body First, we provide a general overview of implementation science and ways in which implementation science has been limited to date. Second, we review principles of behavioral economics and describe how concepts from BE have been successfully applied to healthcare including nudges deployed in the electronic health record. For example, de-implementation of low-value prescribing has been supported by changing the default in the electronic health record. We then describe what a behavioral economics lens offers to existing implementation science theories, models and frameworks, including rich and realistic models of human behavior, additional research methods such as pre-mortems and behavioral design, and low-cost and scalable implementation strategies. We argue that insights from behavioral economics can guide the design of implementation strategies and the interpretation of implementation studies. Key objections to incorporating behavioral economics are addressed, including concerns about sustainment and at what level the strategies work. CONCLUSION: Scholars should consider augmenting implementation science theories, models, and frameworks with relevant insights from behavioral economics. By drawing on these additional insights, implementation scientists have the potential to boost efforts to expand the provision and availability of high quality care.

A Mixed-methods Examination of Culturally Responsive Adaptation to an Evidence-based Parent-mediated Intervention Implemented for Autistic Children.

Parent-mediated interventions (PMIs) are considered an evidence-based practice for fostering social communication skills in young autistic children and for promoting parent responsivity and empowerment, yet barriers to caregiver engagement are evident when PMIs are implemented within historically underserved community settings. Issues of caregiver engagement can reflect a lack of fit between PMIs and the needs of diverse families. We used a mixed methods approach to examine barriers to participating in an evidence-based PMI, Project ImPACT (Ingersoll & Dvortcsak, 2019), within an outpatient setting, as well as strategies that clinicians reported using to deliver and adapt Project ImPACT for minoritized families. Participants included 134 caregivers of a child 13 to 48 months with autism or other social communication differences and six clinicians delivering Project ImPACT. Findings suggest that caregivers experience barriers to participating in Project ImPACT and that these barriers are associated with caregivers' ability to complete the program. Although quantitative findings indicate that adaptation to Project ImPACT did not differ by caregiver and child background, qualitative findings highlighted that clinicians attempt to deliver Project ImPACT to respond to the needs of families from minoritized backgrounds by actively considering the family's culture, psychosocial experiences, goals, and specific barriers. Further, both qualitative and quantitative findings suggest that culturally responsive care and adaptations may support caregiver engagement, including rapport, trust, buy-in, and attendance. Approaches to center cultural alongside contextual/psychosocial considerations within family-centered care in the implementation of PMIs are also highlighted.

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity.

Prominent theories within the field of implementation science contend that organizational leaders can improve providers' fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate's influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals' EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals' increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT-however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.

"Change Doesn't Happen by Itself": A Thematic Analysis of First-Level Leaders' Experiences Participating in the Leadership and Organizational Change for Implementation (LOCI) Strategy.

The Leadership and Organizational Change for Implementation (LOCI) strategy is a multifaceted implementation strategy that aims to support successful evidence-based practice (EBP) implementation by fostering effective general leadership, implementation leadership, and implementation climate. How implementation strategies are experienced by participants is important for their utilization and effectiveness in supporting EBP implementation. The current study is the first in-depth qualitative study exploring first-level leaders' experiences of participating in the LOCI strategy. Data were collected as part of a trial where Norwegian child and adult mental health outpatient clinics implemented EBPs for posttraumatic stress disorder (PTSD). Eleven first-level leaders from adult and child clinics participated in semi-structured interviews after completing the LOCI strategy. Data were analyzed through reflexive thematic analysis. The analysis generated four themes related to leaders' experiences of participating in the LOCI strategy: (1) structuring the EBP implementation, (2) taking responsibility for the EBP implementation, (3) interacting with others about the EBP implementation, and (4) becoming aware of EBP implementation and their own leadership. Most participants experienced the LOCI strategy as beneficial for implementing EBPs for PTSD in their clinic. The strategy succeeded in raising awareness of leadership for EBP implementation, and simultaneously provided participants with tools and support for leading the implementation in their clinic. Two participants experienced LOCI as less beneficial than the others. Our results support the strategy's potential to engage and empower first-level leaders to get involved in implementation processes and point to important challenges for future research on implementation strategies.

Mass Critical Care Surge Response During COVID-19: Implementation of Contingency Strategies - A Preliminary Report of Findings From the Task Force for Mass Critical Care.

BACKGROUND: After the publication of a 2014 consensus statement regarding mass critical care during public health emergencies, much has been learned about surge responses and the care of overwhelming numbers of patients during the COVID-19 pandemic. Gaps in prior pandemic planning were identified and require modification in the midst of severe ongoing surges throughout the world. RESEARCH QUESTION: A subcommittee from The Task Force for Mass Critical Care (TFMCC) investigated the most recent COVID-19 publications coupled with TFMCC members anecdotal experience in order to formulate operational strategies to optimize contingency level care, and prevent crisis care circumstances associated with increased mortality. STUDY DESIGN AND METHODS: TFMCC adopted a modified version of established rapid guideline methodologies from the World Health Organization and the Guidelines International Network-McMaster Guideline Development Checklist. With a consensus development process incorporating expert opinion to define important questions and extract evidence, the TFMCC developed relevant pandemic surge suggestions in a structured manner, incorporating peer-reviewed literature, "gray" evidence from lay media sources, and anecdotal experiential evidence. RESULTS: Ten suggestions were identified regarding staffing, load-balancing, communication, and technology. Staffing models are suggested with resilience strategies to support critical care staff. ICU surge strategies and strain indicators are suggested to enhance ICU prioritization tactics to maintain contingency level care and to avoid crisis triage, with early transfer strategies to further load-balance care. We suggest that intensivists and hospitalists be engaged with the incident command structure to ensure two-way communication, situational awareness, and the use of technology to support critical care delivery and families of patients in ICUs. INTERPRETATION: A subcommittee from the TFMCC offers interim evidence-informed operational strategies to assist hospitals and communities to plan for and respond to surge capacity demands resulting from COVID-19.

Cohort Studies.

Editor's note: This is the seventh article in a series on clinical research by nurses. The series is designed to give nurses the knowledge and skills they need to participate in research, step by step. Each column will present the concepts that underpin evidence-based practice-from research design to data interpretation. The articles will be accompanied by a podcast offering more insight and context from the authors. To see all the articles in the series, go to http://links.lww.com/AJN/A204.

The Fuld Institute for EBP Community Core: Supporting the Patient Perspective in EBP for Optimal Health and Wellness.

Health information and communication fall within patient preferences in evidence-based practice. Now more than ever, patients and families in the community have free access to "evidence" and healthcare information on the internet. However, is that information trustworthy, and how can we encourage people to use evidence to promote their optimal health and wellness? The recent rise of global spread of mis- and disinformation through social media outlets has affected public health. There is growing recognition that social media platforms provide magnified podiums leading to unfortunate outcomes. While much work has been done during the COVID-19 pandemic to address health misinformation, there is still much more work to do. We must respond to the widespread misinformation as a collective healthcare community to prevent poor healthcare decisions. Urging the public to be alert to information spread, assess the quality of health information (and whether it is evidence-based), and use shared decision-making tools is a path we can travel together.

Comparison of Teleintegrated Care and Telereferral Care for Treating Complex Psychiatric Disorders in Primary Care: A Pragmatic Randomized Comparative Effectiveness Trial.

Importance: Only one-third of patients with complex psychiatric disorders engage in specialty mental health care, and only one-tenth receive adequate treatment in primary care. Scalable approaches are critically needed to improve access to effective mental health treatments in underserved primary care settings. Objective: To compare 2 clinic-to-clinic interactive video approaches to delivering evidence-based mental health treatments to patients in primary care clinics. Design, Setting, and Participants: This pragmatic comparative effectiveness trial used a sequential, multiple-assignment, randomized trial (SMART) design with patient-level randomization. Adult patients treated at 24 primary care clinics without on-site psychiatrists or psychologists from 12 federally qualified health centers in 3 states who screened positive for posttraumatic stress disorder and/or bipolar disorder and who were not already receiving pharmacotherapy from a mental health specialist were recruited from November 16, 2016, to June 30, 2019, and observed for 12 months. Interventions: Two approaches were compared: (1) telepsychiatry/telepsychology-enhanced referral (TER), where telepsychiatrists and telepsychologists assumed responsibility for treatment, and (2) telepsychiatry collaborative care (TCC), where telepsychiatrists provided consultation to the primary care team. TER included an adaptive intervention (phone-enhanced referral [PER]) for patients not engaging in treatment, which involved telephone outreach and motivational interviewing. Main Outcomes and Measures: Survey questions assessed patient-reported outcomes. The Veterans RAND 12-item Health Survey Mental Component Summary (MCS) score was the primary outcome (range, 0-100). Secondary outcomes included posttraumatic stress disorder symptoms, manic symptoms, depressive symptoms, anxiety symptoms, recovery, and adverse effects. Results: Of 1004 included participants, 701 of 1000 (70.1%) were female, 660 of 994 (66.4%) were White, and the mean (SD) age was 39.4 (12.9) years. Baseline MCS scores were 2 SDs below the US mean; the mean (SD) MCS scores were 39.7 (14.1) and 41.2 (14.2) in the TCC and TER groups, respectively. There was no significant difference in 12-month MCS score between those receiving TCC and TER (ß = 1.0; 95% CI, -0.8 to 2.8; P = .28). Patients in both groups experienced large and clinically meaningful improvements from baseline to 12 months (TCC: Cohen d = 0.81; 95% CI, 0.67 to 0.95; TER: Cohen d = 0.90; 95% CI, 0.76 to 1.04). For patients not engaging in TER at 6 months, there was no significant difference in 12-month MCS score between those receiving PER and TER (ß = 2.0; 95% CI, -1.7 to 5.7; P = .29). Conclusions and Relevance: In this comparative effectiveness trial of patients with complex psychiatric disorders randomized to receive TCC or TER, significantly and substantially improved outcomes were observed in both groups. From a health care system perspective, clinical leadership should implement whichever approach is most sustainable. Trial Registration: ClinicalTrials.gov Identifier: NCT02738944.

Long-Term Outcomes of a Collaborative Regional Evidence-Based Practice Fellowship.

Academic-practice partnerships provide a model for sharing resources, increasing professional knowledge and skills, improving patient outcomes, and strengthening organizational cultures of quality and safety. This article describes the long-term outcomes of a regional collaborative evidence-based practice fellowship. Results reveal the fellowship had a measurable positive impact on fellows' evidence-based practice knowledge and practice, project outcomes, professional growth, and the culture of excellence within partner organizations.

The Elements of Engagement Framework to Improve Organizational Uptake of Evidence-Based Practice.

Considerable time, money, and training efforts in organizations have been spent advancing evidence-based practice (EBP). Adding science to clinical decision making is profound, yet organizational strategies to ensure mainstream use of EBP as a return on the training investment is sparse. The Elements of Engagement Framework addresses organizational dynamics: emotion, engagement, energy, expectations, and execution to normalize implementation of EBP within the organizational culture. [J Contin Educ Nurs. 2021;52(8):355-358.].

Driving evidence-based improvements for the UK's 'Stressed. Lonely. Overweight. Bored. Aggressive. Misunderstood but loved' companion animals.

BACKGROUND: The Five Welfare Needs in UK animal welfare legislation underpin a legal duty of care and are an animal welfare assessment framework. Health and welfare problems arise when these needs are unmet. The veterinary professions work with others to address these problems, but there is no publicly funded U.K. companion animal welfare surveillance to identify priorities, or promote and monitor change. METHODS: The veterinary charity, the People's Dispensary for Sick Animals (PDSA), together with the market research organisation, YouGov, has undertaken a longitudinal nationwide survey, assessing whether the U.K's pet dogs, cats and rabbits are having their Five Welfare Needs met. Data from nationally representative samples of pet-owning adults, drawn from YouGov's online survey panel, have been used to produce the PDSA Animal Wellbeing (PAW) Report annually since 2011. RESULTS: Examples are given of how the PAW Report has been used to monitor trends in animal welfare problems, drive collaborative behaviour change campaigns, create evidence-based funding applications and inspire innovation in veterinary practice. CONCLUSION: The PAW Report has contributed to closing a gap in national companion animal welfare surveillance. When governments rely on non-governmental organisations to assist with animal welfare surveillance, reliable sources such as the PAW Report can inform research, policy and legislation.

Best Practices for Using Telehealth in Hospice and Palliative Care.

Hospice and palliative care providers throughout the United States have continued to provide compassionate patient- and family-centered care during the COVID-19 (coronavirus disease 2019) pandemic while adapting to the need for scrupulous infection control measures and the accelerated use of telehealth. Prior to the pandemic, hospice and palliative care adopted telehealth slowly compared with other specialties, but its rapidly increasing utilization during the COVID-19 pandemic has long-term implications for access to primary and specialty palliative care, particularly for patients in rural communities and populations experiencing inequitable access to services. Telehealth also shows great promise for leveraging technology to provide care more effectively and efficiently. As more provider organizations become equipped with telehealth infrastructure, and as advocacy for broader reimbursement of these services grows, telehealth services for hospice and palliative care are expected to continue. This article highlights the work of expert clinicians from multiple hospice and palliative care organizations to develop best practices for conducting telehealth visits in inpatient and community settings. The authors propose that best practices be compiled and considered to ensure quality-driven, evidence-based clinical practice guidelines with interprofessional applicability.

'Evidence' within local authority decision making.

Michael Cook looks at the role of an embedded Public Health Information Specialist highlighting the ways the core evidence, information and knowledge skills are used to progress Public Health activity in local government settings. Acknowledging the current pandemic, he explores how COVID-19 has dominated all aspects of health and social care, and outlines how evidence services have work within these complex Public Health systems to lead the local response and recovery efforts.

Cellular Therapy During COVID-19: Lessons Learned and Preparing for Subsequent Waves.

An evidence-based triage plan for cellular therapy distribution is critical in the face of emerging constraints on healthcare resources. We evaluated the impact of treatment delays related to COVID-19 on patients scheduled to undergo hematopoietic cell transplantation (HCT) or chimeric antigen receptor T-cell (CAR-T) therapy at our center. Data were collected in real time between March 19 and May 11, 2020, for patients who were delayed to cellular therapy. We evaluated the proportion of delayed patients who ultimately received cellular therapy, reasons for not proceeding to cellular therapy, and changes in disease and health status during delay. A total of 85 patients were delayed, including 42 patients planned for autologous HCT, 36 patients planned for allogeneic HCT, and 7 patients planned for CAR-T therapy. Fifty-six of these patients (66%) since received planned therapy. Five patients died during the delay. The most common reason for not proceeding to autologous HCT was good disease control in patients with plasma cell dyscrasias (75%). The most common reason for not proceeding to allogeneic HCT was progression of disease (42%). All patients with acute leukemia who progressed had measurable residual disease (MRD) at the time of delay, whereas no patient without MRD at the time of delay progressed. Six patients (86%) ultimately received CAR-T therapy, including 3 patients who progressed during the delay. For patients with high-risk disease such as acute leukemia, and particularly those with MRD at the time of planned HCT, treatment delay can result in devastating outcomes and should be avoided if at all possible.

Literature Review and Knowledge Distribution During an Outbreak: A Methodology for Managing Infodemics.

PROBLEM: The COVID-19 pandemic has challenged health care systems in an unprecedented way by imposing new demands on health care resources and scientific knowledge. There has also been an exceedingly fast accumulation of new information on this novel virus. As the traditional peer-review process takes time, there is currently a significant gap between the ability to generate new data and the ability to critically evaluate them. This problem of an excess of mixed-quality data, or infodemic, is echoing throughout the scientific community. APPROACH: The authors aimed to help their colleagues at the Rambam Medical Center, Haifa, Israel, manage the COVID-19 infodemic with a methodologic solution: establishing an in-house mechanism for continuous literature review and knowledge distribution (March-April 2020). Their methodology included the following building blocks: a dedicated literature review team, artificial intelligence-based research algorithms, brief written updates in a graphical format, large-scale webinars and online meetings, and a feedback loop. OUTCOMES: During the first month (April 2020), the project produced 21 graphical updates. After consideration of feedback from colleagues and final editing, 13 graphical updates were uploaded to the center's website; of these, 31% addressed the clinical presentation of the disease and 38% referred to specific treatments. This methodology as well as the graphical updates it generated were adopted by the Israeli Ministry of Health and distributed in a hospital preparation kit. NEXT STEPS: The authors believe they have established a novel methodology that can assist in the battle against COVID-19 by making high-quality scientific data more accessible to clinicians. In the future, they expect this methodology to create a favorable uniform standard for evidence-guided health care during infodemics. Further evolution of the methodology may include evaluation of its long-term sustainability and impact on the day-to-day clinical practice and self-confidence of clinicians who treat COVID-19 patients.